An echolocation apparatus

ABSTRACT

An apparatus comprises an echolocation module configured to determine a distance to the object based on the received sound signal reflected from an object. The echolocation module determines surroundings based on the determined distance. A processor is configured to modify one or more attributes of the apparatus based on the determined surroundings.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.14/002,218, filed Aug. 29, 2013, which is a national phase entryInternational Application No. PCT/IB2011/051066, filed Mar. 14, 2011,the entire contents of which are incorporated herein by reference.

FIELD

The present application relates to a method and apparatus forecholocation for an electronic device. In some embodiments the methodand apparatus relate to ultrasonic echolocation for an electronic devicefor determining the surroundings of the electronic device.

BACKGROUND

Mobile devices such as smartphones are ever more focussed on providingincreased connectivity for a user. For example, many mobile devices canaccess data networks, deliver email, and provide instant messaging, toname a few available features. Many users value the ability of mobiledevices to retrieve documents, messages and other information on themove.

However some users have found that more connectivity can increase theamount of information received by their mobile device which can beinconvenient at times. For example, the mobile device can notify a userabout a new email but the user may not have sufficient time to properlydeal with the new email. Nevertheless, even though a user may be doingsomething else the user may feel compelled to read the email in responseto the notification. The distracted user may read the email whilst beingpreoccupied with other tasks but then forget later to react to theemail.

Other users have found that the increased amount of information receivedby the mobile device can provide an unacceptable level of notificationswhich can distract a user from other tasks. Turning off the mobiledevice may not be an option for some users because they may need theability to receive important phone calls or important messages. Anotheroption is operating the mobile device in a silent mode. However, it hasbeen noted that some users can still be inconveniently distracted bysilent notifications such as a vibration alert or a change in colour ofa flashing light on the electronic device.

One known solution has been to use location information of the mobiledevice to change the behaviour of the mobile device. For example, themobile device can determine that it is in transit based on the locationinformation and modify the behaviour of the mobile device. However, insome circumstances users may not wish to be disturbed by the mobiledevice even if they are no longer in transit. A user may wish to hold aconversation with someone else in person without being distracted bynotifications generated by the mobile device.

Alternatively, the mobile device can determine that the user is at atrain station from location information. The user, however, may not wishto receive notifications when the user is waiting at a train platformand in very close proximity to other passengers.

Embodiments of the invention aim to address one or several of the aboveissues.

In accordance with an embodiment there is provided an acoustictransducer comprising; a sound generator configured to operate in anfirst mode for generating audible sounds and to operate in a second modefor generating ultrasonic sounds.

The sound generator is configured to operate in the first and secondmodes at the same time. Alternatively the sound generator is configuredto operate in the first and second modes at different times. This meansthat a single sound transmitter can be used to generate both audio andultrasound signals, which can be generated at the same time or adifferent times.

In accordance with another embodiment there is an acoustic transducercomprising: a sound detector configured to detect audible sounds in afirst mode and to detect ultrasonic sounds in a second mode.

The sound detector is configured to operate in the first and secondmodes at the same time. Alternatively the sound detector is configuredto operate in the first and second modes at different times. This meansa single sound receiver can be used to detect both ultrasound and audiosignals.

The transducer can be a microphone module. The acoustic transducer canbe a microelectromechanical system. The ultrasonic sounds have afrequency of above 20 KHz.

In accordance with an embodiment there is an acoustic transducercomprising: a sound generator configured to operate in an first mode forgenerating audible sounds and to operate in a second mode for generatingultrasonic sounds; and a sound detector configured to detect audiblesounds in a first mode and to detect ultrasonic sounds in a second mode.In this way the acoustic transducer can operate both as a transmitterand a receiver. This can save space and complexity of manufacture of aelectronic device using the transducer.

In accordance with an embodiment there is an electronic devicecomprising one or more above mentioned acoustic transducers. Theelectronic device can be a mobile phone.

In accordance with an embodiment there is a headset comprising one ormore above mentioned acoustic transducers. The headset can be wirelesslyor wire connected with the electronic device. The headset can send andreceive sound signals in different directions in addition to oralternatively to the electronic device. The headset can send and receivesound signals along a different direction, if for example, thetransducers on the electronic device are obscured.

In accordance with an embodiment there is a method comprising:generating an audible sound signal in a first mode; and generating anultrasonic sound signal in a second mode.

The first and second modes can occur at the same time or the first andsecond modes can occur at different times.

In accordance with an embodiment there is a method comprising: detectingaudible sounds in a first mode; and detecting ultrasonic sounds in asecond mode.

The first and second modes can occur at the same time or the first andsecond modes can occur at different times.

The ultrasonic sounds can have a frequency of above 20 KHz.

In accordance with an embodiment there is an apparatus comprising: meansfor generating an audible sound signal in a first mode and generating anultrasonic sound signal in a second mode.

In accordance with an embodiment there is an apparatus comprising: meansfor detecting an audible sound signal in a first mode and detecting anultrasonic sound signal in a second mode.

In accordance with an embodiment there is a method comprising:determining a distance to the object based on the received sound signalreflected from an object; determining surroundings based on thedetermined distance; and modifying one or more attributes of anelectronic device based on the determined surroundings. The methodperforms echolocation and on determining a distance to an object fromthe echolocation, the environmental surroundings can be determined andthe electronic device altered accordingly. Determining the surroundingscan be determining the type of surroundings, such as whether theelectronic device is in a building or vehicle. The determining thesurroundings can be determining the type of surroundings or a particularknown surroundings. Modifying attributes/functionality of the electronicdevice can allow the user to continue using the electronic device butnot have to be distracted by the electronic device at inconvenienttimes.

The method can comprises receiving the sound signal reflected from theobject. The method comprises sending a sound signal towards the object.The acoustic transducer sending the sound signal can be separate fromthe electronic device.

The sound signal is an ultrasound signal which means that the ultrasoundsignal may not interfere with audio signals. Additionally an ultrasoundsignal can provide additional resolution over audible sound signals usedin echolocation.

The method can comprise receiving sensor information and determining thesurroundings based on the received sensor information and the determineddistance. The surroundings can be better determined with additionalinformation received about the surroundings. The received sensorinformation can be any of the following: global positioning systeminformation; temperature information, power signal information, batterysignal information, acceleration information, vibration information,brightness information, data usage information, call usage information,compass information, gyroscopic information or any other sensorinformation.

The method can comprise comparing the determined distance informationwith stored distance information. The determined distance informationcan be compared against known location and distance information. Thestored information can be a information associated with preferred orlikely locations in which the electronic device might be.

The method can comprises determining that the determined distanceinformation matches with the stored distance information and retrievingsurrounding information associated with the stored distance information.This means the behaviour of the electronic device can be modifieddepending on the determined location of the electronic device.

The method can comprises receiving sound signals in a plurality ofdirections and determining the distance to a plurality of objects. Theecholocation can be performed in a plurality of directions to ascertaingreater spatial information of the electronic device with respect to itslocality.

The method can comprise storing distance information and/or sensorinformation associated with a particular surroundings. In this way theelectronic device can be trained to learn about the particularsurroundings.

The method can comprise storing modifying information associated withthe particular surroundings for modifying the electronic device when theelectronic device is at the particular surroundings.

The modifying the attributes of the electronic device can comprisemodifying when the electronic device generates notifications. Thenotifications can be associated with one or more of the following calls,emails, SMS messages, MMS messages, alarms or any other communicationevent.

A computer program comprising program code means adapted to perform themethod may also be provided.

In accordance with an embodiment there is an apparatus comprising: anecholocation module configured to determine a distance to the objectbased on the received sound signal reflected from an object; anddetermine surroundings based on the determined distance; and a processorconfigured to modify one or more attributes of the apparatus based onthe determined surroundings.

The apparatus can comprise one or more acoustic transducers configuredto receive the sound signal reflected from the object.

The apparatus can comprise one or more transducers configured to send asound signal towards the object.

The acoustic transducers can be configured to send and/or receive anultrasonic sound signal.

The apparatus can comprise one or more sensors configured to sendinformation to the echolocation module for determining the surroundingsbased on the received sensor information and the determined distance.

The one or more sensors information can be any of the following: globalpositioning system sensor; temperature sensor, power signal sensor,battery signal sensor, acceleration sensor, vibration sensor, brightnesssensor, data usage sensor, call usage sensor, compass sensor, gyroscopicsensor, near field communication sensor or any other sensor.

The echolocation module can be configured to compare the determineddistance information with distance information stored in memory.

The echolocation module can be configured to determine that thedetermined distance information matches with the stored distanceinformation and retrieve surrounding information associated with thestored distance information.

The apparatus can comprise a plurality of acoustic transducers forreceiving and sending sound signals to a plurality of objects. Theplurality of acoustic transducers can be located on different faces ofthe apparatus.

The processor can be configured to modify when the apparatus generatesnotifications for a user. The notifications can be associated with oneor more of the following calls, emails, SMS messages, MMS messages,alarms or any other communication event.

In accordance with an embodiment there is a mobile phone comprising theabove mentioned apparatus.

In accordance with an embodiment there is an apparatus comprising: meansfor determining a distance to the object based on the received soundsignal reflected from an object; means for determining surroundingsbased on the determined distance; and means for modifying one or moreattributes of an electronic device based on the determined surroundings.

In accordance with an embodiment there is an apparatus comprising atleast one processor and at least one memory including computer code, theat least one memory and the computer code configured to with the atleast one processor cause the apparatus to at least perform: determine adistance to the object based on the received sound signal reflected froman object; determine surroundings based on the determined distance; andmodify one or more attributes of an electronic device based on thedetermined surroundings.

Various other aspects and further embodiments are also described in thefollowing detailed description and in the attached claims.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of the present application and as to how thesame may be carried into effect, reference will now be made by way ofexample to the accompanying drawings in which:

FIG. 1 illustrates a schematic block diagram of an electronic devicecomprising an echolocation apparatus according to some embodiments;

FIG. 2 illustrates a schematic perspective view of an electronic devicecomprising a transmitter/receiver arrangement for echolocation accordingto some embodiments;

FIGS. 3 and 4 illustrate echolocation being performed by an electronicdevice according to some embodiments.

FIG. 5 illustrates a flow diagram of an echolocation method according tosome embodiments; and

FIG. 6 illustrates a flow diagram of an echolocation method according tosome other embodiments.

DETAILED DESCRIPTION

The following describes apparatus and methods for echolocation for anelectronic device for determining the surroundings of the electronicdevice.

In this regard reference is made to FIG. 1 which discloses a schematicblock diagram of an example electronic device 100 or apparatus suitablefor employing embodiments of the application. The electronic device 100is configured to perform echolocation for determining the surroundingsof the electronic device 100.

The electronic device 100 is in some embodiments a mobile device, e.g. amobile terminal, a mobile phone or user equipment for operation in awireless communication system. In other embodiments, the electronicdevice 100 is a personal computer, a laptop, a smartphone, personaldigital assistant (PDA), or any other electronic device 100 suitable foraudio communication with another device.

In other embodiments, the electronic device 100 is any suitableelectronic device 100 configured to generate sound, such as for examplea digital camera, a portable audio player (mp3 player), a portable videoplayer (mp4 player). In other embodiments the apparatus may be anysuitable electronic device with a speaker configured to generate sound.

The electronic device 100 comprises a transducer or an sound transmitter102 connected to a digital to analogue converter (DAC) 104 and anothertransducer or an sound microphone 106 connected to an analogue todigital converter (ADC) 108 which is connected to a processor 110. Theprocessor 110 is connected to a transceiver (TX/RX) 112 via anencoder/decoder (not shown), to a user interface (UI) 114 and to memory116. The electronic device 100 can send and receive signals via thetransceiver 112 to and from another electronic device. The transmitter102 may be an integrated speaker such as an integrated hands freespeaker (IHF), loudspeaker or an earpiece.

The transmitter 102 may be a dynamic or moving coil, a piezoelectrictransducer, an electrostatic transducer or a transducer array comprisingmicroelectromechanical systems (MEMS). Additionally or alternatively thetransducer comprises a multifunction device (MFD) component having anyof the following; combined earpiece, integrated handsfree speaker,vibration generation means or a combination thereof

The user interface 114 may enable a user to input commands or data tothe electronic device 100. Any suitable input technology may be employedby the electronic device 100. It would be understood, for example, theapparatus in some embodiments may employ at least one of a keypad,keyboard, mouse, trackball, touch screen, joystick and wirelesscontroller to provide inputs to the electronic device 100.

The digital to analogue converter (DAC) 104 and the analogue to digitalconverter (ADC) 108 may be any suitable converters. The DAC 104 can sendan electronic sound signal output to the sound transmitter 102 and onreceiving the sound signal from the DAC 104, the sound transmitter 102can generate acoustic waves. The sound microphone 106 can detectacoustic waves and generate a sound signal which is sent to theprocessor 110 via the ADC 108.

The processor 110 in some embodiments can be configured to executevarious program codes. For example, the implemented program code cancomprise a code for sound signal processing or configuration. Theimplemented program codes in some embodiments further compriseadditional code for estimating background noise of audio speech signals.The implemented program codes can in some embodiments be stored, forexample, in the memory 116 and specifically in a program code section118 of the memory 116 for retrieval by the processor 110 wheneverneeded. The memory 116 in some embodiments can further provide a section120 for storing data, for example, data that has been processed inaccordance with the application. The code may, in some embodiments, beimplemented at least partially in hardware or firmware.

The electronic device 100 can comprise an echolocation module 122 or anysuitable means for determining distance of objects from the electronicdevice 100 from a sound signal. The echolocation module 122 can beconnected to the processor 110. In some embodiments the echolocationmodule 122 can be replaced with the processor 110 which can carry outthe echolocation processing operations. The echolocation module 122 insome embodiments can be an application specific integrated circuit.

Some embodiments will now be described in reference to FIG. 2. FIG. 2illustrates a schematic perspective view of an electronic device 100comprising a transmitter and receiver arrangement for echolocation.

In some embodiments the electronic device 100 comprises one or moreultrasonic transmitters 102 and one or more ultrasonic receivers 106 forperforming echolocation for determining the distance of the electronicdevice 100 from one or more objects. In some embodiments the ultrasonictransmitter 102 and the ultrasonic receiver may be the same audiotransmitter and audio receiver arrangement used for generating anddetecting audible sound frequencies. That is, the ultrasonic transmitter102 may be configured to generate sound signal in an ultrasound rangeand a sound signal in the audible range. Similarly the ultrasonicreceivers 106 can be configured to receive a sound signal in anultrasound range as well as an audio signal in an audible range. In someembodiments the ultrasonic transmitter 102 is configured to generate asound signal of a frequency above 20 KHz. Similarly the ultrasonicreceiver 106 is configured to detect a sound signal with a frequencyabove 20 KHz.

FIG. 2 illustrates the arrangement of ultrasonic transmitters andreceivers 102, 106 distributed across the electronic device 100. Theultrasonic transmitter 102 can be located in alignment with a hole inthe body 200 of the electronic device 100. A plurality of ultrasonictransmitters 102 can be located on a plurality of faces of theelectronic device 100. For example, in some embodiments the electronicdevice can comprise six faces, one of which comprises a display. Theultrasonic transmitters 102 can be aligned with a hole in each face ofthe electronic device 100. For example, if the electronic devicecomprises six sides in a box-type shape the ultrasonic transmitters 102can send an ultrasonic signal in six different directions. In someembodiments the ultrasonic transmitter 102 is not located on the samesurface as the display.

In some embodiments there can be the same number of ultrasonic receivers106 as there are ultrasonic transmitters. In this way, each surface cancomprise an ultrasonic transmitter 102 and an ultrasonic receiver 106.

In other embodiments, the electronic device 100 can comprise a singleultrasonic transmitter 102 and a plurality of ultrasonic receivers 106.The body 200 of the electronic device can comprise a cavity adjacent tothe ultrasonic transmitter 102 which is tuned to the ultrasonicfrequency range. The cavity within the electronic device 100 can bearranged to direct an ultrasonic signal from the ultrasonic transmitter102 to a plurality of holes in difference surfaces device 100. In thisway, one ultrasonic transmitter 102 can be used to provide a pluralityof ultrasonic beams in a plurality of directions. Similarly anultrasonic receiver 106 can be located next to each of the ultrasonicoutput holes.

In some embodiments the electronic device 100 can comprise an openinghaving an adjustable size. The adjustable opening can be varied in orderto tune the acoustics properties to ultrasound and audio frequenciesdepending on whether an ultrasound signal or an audio signal is to begenerated. The processor 110 can control the size of the adjustableopening. In some embodiments the body 200 comprises an electricallycontrollable material or mechanism to adjust the size of the opening. Insome embodiments an electroactive polymer or electrically controllableflaps are used to adjust the size of the opening.

Alternatively, the electronic device 100 comprises a single ultrasonictransmitter which transmits a wide beam ultrasonic signal from singlesurface. In this way, the wide beam ultrasonic signal is transmittedfrom a single surface.

In an alternative embodiment there can be one or more ultrasonictransducers which can transmit and receive ultrasonic signals. In thisway, an ultrasonic transducer of the electronic device 100 can beconfigured to operate in two modes; transmitting an ultrasonic signaland receiving an ultrasonic signal. The ultrasonic transducer cantransmit a pulse of an ultrasonic signal in the first mode then switchto a second mode for listening to the echo of the ultrasonic pulse. Insome embodiments one or more ultrasonic transducers capable of sendingand receiving an ultrasonic signal can be located on one or moresurfaces of the electronic device 100.

In some embodiments the echolocation is performed using separateultrasonic transmitters 102 and ultrasonic receivers 106. In some otherembodiments an audible sound can be used to perform echolocation. Forexample a high frequency audible audio signal can be used forecholocation. In some embodiments an ultrasound signal is used toperform echolocation because the ultrasound signal does not interferewith other audio signals generated by the electronic device 100 forexample, a phone call. Furthermore an ultrasound signal can providebetter resolution when using echolocation for detecting objects.

The process of echolocation will now be described using FIGS. 3 and 4.FIGS. 3 and 4 illustrate echolocation being performed by the electronicdevice 100.

In a first mode the transmitter 102 sends an ultrasonic signal 300. Insome embodiments the ultrasonic signal is sent in a series of pulses302, 304, 306. The ultrasonic signal can be directed towards one or moreobjects using a beam forming process. In some embodiments the ultrasonicsignal is beam formed using an opening in the body 200 of the electronicdevice 100 aligned with the ultrasonic transmitter 102. In otherembodiments the ultrasonic transmitter 102 can be arranged to transmitan ultrasonic signal over a wide area. In this way FIG. 3 shows a seriesof pulses 300, 302, 304 and 306 which propagate towards objects 308,310. In this case, the objects 308, 310 are walls, but the objects canbe any object which can reflect the ultrasound signal.

FIG. 4 shows the electronic device 100 operating in a second mode. Inthe second mode the ultrasonic receivers 106 listen for one or morereflected ultrasonic signals from the objects 308, 310. In someembodiments the electronic device 100 does not operate in both the firstand second modes at the same time. Since the electronic device 100 has atransmitting mode and a receiving mode the ultrasonic transmissions fromthe ultrasonic transmitter 102 do not interfere with the ultrasonicreceivers 106 listening for the reflected ultrasonic echoes.

The distance from the electronic device 100 to the objects 308, 310 canbe determined from the time lapse between the ultrasound transmitter 102sending an ultrasound pulse and the ultrasound receiver 106 receivingthe same ultrasound pulse. This time difference is the time for theultrasound pulse to travel to the object 308, 310 and then return fromthe object 308, 310 to the electronic device 100. In this way half thetime delay between transmitting the ultrasound signal and receiving theultrasound signal multiplied by the speed of sound in air is thedistance of the electronic device 100 from the object 308, 310.

In some embodiments the electronic device 100 can perform an additionaldistance determination step. After the electronic device 100 hasdetermined the distance, the processor 110 can initiate the ultrasoundtransmitter 102 to generate a continuous ultrasound signal. Theultrasound transmitter 102 can set up a standing wave between theelectronic device 100 and the object 308, 310. The echolocation modulecan them compare the received ultrasound signal with the transmittedsignal and determine the phase difference between the two.

The echolocation module 122 can then more accurately determine thedistance based on the phase difference, than timing the length of timean ultrasonic pulse takes to propagate to and from an object.

Some detailed embodiments will now be described with reference to FIG.5. FIG. 5 discloses a method for performing echolocation at anelectronic device 100.

The ultrasound transmitter 102 sends an ultrasound pulse at a first timeas shown in block 502 as discussed in reference to FIG. 3. Theultrasound pulse propagates from the electronic device 100 and isincident on a nearby object 308, 310. Depending on the shape,orientation, structure and material of the object 308, 310 theultrasound pulse is reflected by the object 308, 310. Usually the objectreflecting the ultrasound pulse back towards the electronic device 100has a hard surface such as a wall, window or door of a building orvehicle.

The reflected ultrasound pulse propagates from the object 308, 310 tothe electronic device 100. At a second time the ultrasound microphone106 receives the reflected ultrasound pulse as shown in block 504. Insome embodiments the ultrasound transmitter 102 sends an ultrasoundpulse when the ultrasound microphone 106 is not listening. This canprevent interference from the ultrasound transmitter 102 at theultrasound microphone 106.

When the ultrasound signal is incident at the ultrasound microphone theultrasound microphone 106 is activated and sends an analogue signalrepresenting the ultrasound signal to the analogue to digital converter108. The analogue to digital converter 108 sends a signal to theprocessor 110. The processor 110 then sends the ultrasound signalreceived at the microphone 106 to the echolocation model 122. Inaddition the processor 110 receives information from the ultrasoundtransmitter with respect to the time that the received ultrasound signalat the ultrasound microphone 106 was initially transmitted by theultrasound transmitter 102. The processor 110 sends the timinginformation to the echolocation module 122.

The echolocation module 122 then initiates the echolocation methodaccording to some embodiments.

The echolocation module 122 then determines the distance to objects 310,308 according to the following equation (1):

$\begin{matrix}{D = {\frac{\Delta \; t}{2} \times S}} & (1)\end{matrix}$

Where D is the distance from the electronic device 100 to the objects308, 310, Δt is the time lapse between sending the ultrasound pulse andreceiving the ultrasound pulse and S is the speed of sound in air.

In some embodiments the echolocation module 122 can determine thedistance to objects 308, 310 as shown in block 506 for a plurality ofobjects. Indeed, in some embodiments there are a plurality of ultrasoundmicrophones 106 located on each surface of the electronic device 100 andthe echolocation module 122 can determine the distance to the object foreach ultrasound microphone 106.

For example the electronic device 100 can be situated in a room and aplurality of ultrasound pulses can be sent in a plurality of directionstowards different walls, windows, ceilings or floors. Thereafter thereflected ultrasound pulses can be received by a plurality of ultrasoundmicrophones 106. In this way the ultrasound microphones 106 can receivea plurality of reflected pulses from different directions. Theecholocation module 122 can then determine the distance of theelectronic device 100 from each wall, floor and ceiling in the room. Inthis way the echolocation module 122 can determine spatial location ofthe electronic device 100 within the room.

In some embodiments the transmitter 102 sends a plurality of ultrasonicpulses reflected back from the objects. The echolocation module 122 cancombine the determined distances from a plurality of ultrasonic pulsesto provide a more accurate distance determination. In some embodimentsthe echolocation module 122 takes a mean average of a determineddistance of the plurality of ultrasonic pulses.

In some other embodiments a plurality of transmitters can sendultrasonic pulses at difference frequencies. In this way the frequencyof the received ultrasonic pulse at an associated microphone can bedetermined. The echolocation module 122 can then determine that areflected ultrasonic pulse received at an ultrasonic microphone has beenreflected off the intended object. For example, the echolocation module122 can disregard any received ultrasonic pulse received at a microphonewhich does not receive a pulse of the correct frequency. In this way theecholocation module can avoid distance errors calculated from secondaryechoes reflected off a plurality of objects. Indeed a transmitter andreceiver can be associated with a certain frequency of ultrasonic pulse.

The echolocation module 122 can then determine the surroundings based onthe determined distance to the objects 308, 310 as shown in step 508.

In some embodiments a single ultrasound transmitter and microphonearrangement is provided. In this way an ultrasound pulse can be sent andreceived in a single direction. That is the echolocation module candetermine the distance of the electronic device 100 to a single surface.For example, the echolocation module 122 can determine that theelectronic device 100 is no longer in an open area and is now close to awall. The echolocation module 122 then sends surrounding information tothe processor 110. The processor 110 then initiates modifying attributesof the electronic device 100 based on the determined surroundinginformation as shown in block 510.

In some embodiments the electronic device 100 is a mobile device and theprocessor 110 modifies the behaviour of the device once the echolocation122 has determined the mobile device 100 is close to a wall. In someembodiments the processor 110 can modify the acoustic properties of thephone because the processor 110 knows that the mobile device 100 isclose to a wall. In this way, the volume and other associated propertiesof the audio transducer can be adjusted because the wall may provideshelter for the user. In some embodiments any behaviour or functionalityof the phone can be modified in response to the determination to thesurroundings of the electronic device 100.

In some further embodiments the echolocation module 122 can optionallyreceive additional information as shown in block 512. In someembodiments the additional information can be sensor output informationfrom other sensors of the electronic device. For example, theecholocation module 122 can receive location information from a GPSsensor (not shown). In this way, the echolocation module can determinethe estimated location of the electronic device 100 from the GPSlocation information but can further determine the surroundings of theelectronic device 100 from both the GPS location information and thedetermined distance to objects. For example, the echolocation module,can determine that an electronic device 100 is near a building orvehicle from the GPS location information and then determine whether theelectronic device 100 is inside or outside a building or vehicle fromthe determined distance information. In some embodiments the electronicdevice 100 can be determined from the GPS location information that theelectronic device 100 is at the train station. In addition, theecholocation module 122 can determine whether the electronic device isinside or outside the train at a platform of the station. Thereforebased on the information the echolocation module can send the determinedsurrounding information to the processor 110.

The processor 110 can then determine that the electronic device 100should modify its behaviour whilst the electronic device is located onthe train platform. For example, the processor 110 can stop emailnotifications, instant message notifications and other low prioritynotifications from being generated whilst the electronic device 100 andhence the user of the electronic device 100 is waiting for the train onthe platform. This can prevent the user from being distracted bynotifications at an inconvenient time. Modifying the functionality ofthe electronic device 100 can also prevent other passengers from seeingthe notification if they are in close proximity to the electronic device100. At a later time the echolocation module 122 can determine from theGPS location information and the determined distance information thatthe electronic device is in the train station but is now located withina train carriage. The processor 110 can then determine that the userwishes to receive notifications and can send notifications to the userwithin the train carriage. In some embodiments the mobile device 100 canbuffer notifications from memory until the determined surroundings meetwith criteria with generating notifications. In some embodiments thecriteria for generating notification can be modified by the user duringa set up phase which is discussed in reference to the embodiments inFIG. 6. The user for example could modify the criteria so that some,none or all notifications are generated by the electronic device 100.

Similarly, the echolocation module 122 can determine from the GPSlocation information that the electronic device 100 is in transit. Forexample, the echolocation module 122 can determine that the electronicdevice is moving with a user at walking pace within a building. The usercan set the criteria stored in memory of the electronic device to onlygenerate notifications when the user is not walking but is stationaryfor a certain period of time.

In other embodiments additionally or alternatively other sensorinformation can be sent to the echolocation module 122. For example,information concerning acceleration of the electronic device 100 from anaccelerometer sensor, can be used. Again the echolocation module candetermine from the accelerometer information and the determined distanceinformation whether the electronic device is in a relatively staticenvironment and thus is allowed to receive notifications.

In some embodiments the echolocation module 122 can determine from theGPS information and the ultrasonic information the type of vehicle theuser is in. For example, the echolocation module 122 can determine fromthe GPS information that the electronic device 100 is moving on a roadand from the determined distance information from the ultrasonicmeasurements that the electronic device 100 is in an elongated space. Inthis way the echolocation module 122 can determine that the electronicdevice 100 is moving along a road in a long vehicle such as a bus. Theprocessor 100 from this information can know that the user is notdriving the vehicle and can adjust the functionality such as allowingsending notifications to the user.

In some embodiments, the echolocation module 122 can determine the levelof attenuation between the transmitted ultrasound pulse and the receivedreflected ultrasound pulse. Depending on the level of attenuation of thereceived reflected pulse, the echolocation module 122 can determinewhether the object 308, 310 comprises a hard or soft surface. In thisway, the echolocation module 122 can tell the difference between seatsof a vehicle and other harder objects. In some embodiments, theecholocation module 122 can perform an additional step of determiningthe type of material near the electronic device 100 after the distancedetermination has been made in order to verify that the electronicdevice 100 and the user are in a particular environment, such as on atrain or a bus.

In additional or alternative embodiments other information can be sentto the echolocation module 122. Indeed one or more of the following canbe used by the echolocation module data usage, call usage, compassinformation, gyroscope information, brightness information from a lightsensor, information received by wireless network / connection,information received by near field communication, battery level, signallevel or any other sensor information of the electronic device 100 orsensor information received by the electronic device 100.

In some embodiments, the echolocation module 122 can perform errorcorrection on the ultrasonic distance determination. The ultrasonicdetection can be disturbed if the electronic device 100 is constantlymoving, rotating, vibrating etc. The echolocation module 122 can receivedata from other sensors such as gyroscope, and/or accelerometers whichcan be used to cancel the inaccuracy caused by movement of theelectronic device 100. In this way the echolocation module 122 can beconfigured to compensate for the changes in the time it takes for thesound to reach the surfaces of objects 308, 310 and return to theelectronic device's ultrasonic receivers 106 due to the movement of theelectronic device 100.

Optionally, the echolocation module 122 can compare determined distanceinformation with stored information as shown in block 514. In this way,the echolocation module 122 can retrieve from memory a list of preferredlocations for modifying the functionality of the electronic device 100.For example the processor 100 can determine that the functionality ofthe electronic device 100 is modified if the electronic device is in aroom of a certain size. In some embodiments, the echolocation module 122can recognise preferred rooms for modifying the electronic device 100based on the determined distance and, for example, the GPS locationinformation.

In some embodiments the electronic device 100 can be set up to betrained to determine when the electronic device is to be modified. Theset up phase is shown in FIG. 5 as block 516.

The set up phase of the electronic device 100 will now be discussed withreference to FIG. 6. FIG. 6 discloses a method according to someembodiments of setting up the electronic device 100.

When the electronic device 100 is being trained to recognise locationsthe electronic device will perform steps 502, 504 and 506 as shown inFIG. 5. That is, the echolocation module 122 determines the distance tonearby objects 308, 310 of the electronic device 100. For example theelectronic device 100 can be in a room and the echolocation module 122has determined the distance to the walls.

The echolocation module 122 can then optionally receive additionalsensor information as required in step 602. Similar to the method shownin FIG. 5 the additional sensor information can be information from asensor of the electronic device 100. For example in some embodiments theadditional sensor information can be information regarding locationretrieved from a GPS sensor. In some embodiments the echolocation module122 receives information of the determined distance and the additionalsensor information for storing in memory of the electronic device 100.The processor 110 can then receive input from a user regarding how theelectronic device is to be modified when the electronic devicedetermines that the determined distance information and additionalsensor information are the same. In some alternative embodiments theuser does not input information as to how the electronic device is to bemodified. Instead, the electronic device 100 can be pre-programmed toreact to certain criteria.

The input is received from the user as shown in step 604. In someembodiments the input from a user can be the user selecting an operationfrom a list on a display of the electronic device 100. For example auser can select “notifications only on the train or at the office”. Inthis way, as discussed previously, the user will only see notificationsgenerated by the electronic device 100 when the echolocation moduledetermines that the electronic device 100 is on a train or at theoffice. The processor 110 then stores the location information and theassociated attributes for modifying the mobile device in memory 116 asshown in step 606. In this way the electronic device 100 knows whataction to take when the electronic device is in different places.

In some embodiments the ultrasound transmitter 102 is not integratedwith the electronic device 100. Instead the ultrasound transmitter 102can be located in a headset. In this way the ultrasound transmitter canbe arranged to send a pulse to nearby objects when the headset with theultrasound transmitter 102 is being used. Of course, in some embodimentsthe headset does not need to be in use by a user for an ultrasoundtransmitter 102 located thereon to transmit an ultrasonic pulse to anearby object. At the same time, the ultrasound transmitter 102 isconfigured to send timing information to the processor 110.

In another embodiment the electronic device 100 can be taught to blockall or some messages and call notifications when the user is sleeping.For example, the processor 100 can be instructed to only allow importantcalls and/or clock alarm to sound when the user is at home in a bedroomand the electronic device 100 is stationary. Optionally the processor100 can determine whether to modify the message and call notificationsbased on whether there is movement, for example people walking nearbythe electronic device 100. In some embodiments the echolocation module122 determines that the user is at home from the GPS information and/orthe ultrasound determined distance the echolocation module 122determines that the user is in a bedroom from the ultrasound determineddistance.

In some other embodiments the electronic device 100 can be used in anenvironment where the user is visually impaired, for example theenvironment may be dark, smoke filled or the user themselves may bevisually impaired. The electronic device may use the determined distanceinformation from the ultrasound signal to determine the surroundings ofthe electronic device 100. The processor 110 can compare the determinedsurroundings of the electronic device 100 with previously determined orstored surroundings information. In this way the processor 110 canprovide navigation information to the user of the electronic device 100based on the comparison. In some embodiments the electronic device candetermine the location of an exit of a building based on determinedtransition information. For example, the processor 110 can determinethat the electronic device has entered a building from GPS informationand ultrasound signals. The processor 110 can automatically determinethe exit of the building for future reference of the electronic device100. Furthermore, the electronic device 100 can navigate to a previouslystored location, for example a waypoint, in a building.

In some embodiments similar navigation can be used to navigate the userto their car in car park. For example, the car park can be anunderground car park where GPS location information is not available.The processor 110 can determine from the output of the echolocationmodule 122 based on ultrasound distance determination, gyroscopeinformation and/or accelerometer information navigation instructions fordirecting a user to the parked car.

In some further embodiments, the electronic device 100 can comprise anear field communication (NFC) sensor (not shown) and receive data viathe NFC sensor. In some embodiments the electronic device 100 canreceive data from radio frequency NFC tags at the entrances of buildingssuch as department stores and hotel. The data can comprise informationof the layout of the building. This means when the electronic device 100enters a building, the electronic device can receive layout informationof the building. Alternatively, the electronic device 100 can receivethe layout information via any other suitable communication means, forexample over a wireless network. The layout information can then bestored in memory 116 for indoor navigation or emergencies as discussedin reference to previous embodiments.

In some other embodiments the processor 110 can determine from theoutput of the echolocation module 122 that the electronic device 100 isin a pocket or a bag. The echolocation module 122 can determine from theultrasonic distance determination that the distance from the electronicdevice 100 that the electronic device 100 is in very close proximity toan object. The echolocation module 122 can determine that the electronicdevice 100 is within another object, for example a pocket or a bag orcase if the echolocation module determines that the electronic device isin very close proximity to object in more than one direction. Theecholocation module 122 can send a signal to the processor 110 and theprocessor 110 can modifies the functionality of the electronic device100. For example, the processor 110, having determined the electronicdevice 100 is in a bag, can adjust the volume of the device so that theuser is more likely to hear the electronic device 100. Additionally, theecholocation module 122 can receive additional sensor information fromtemperature sensors and/or accelerometers to indicate that theelectronic device 100 is in a pocket or a bag.

Alternatively, or additionally the processor 110 can receive informationfrom temperature sensors and/or accelerometers and the processor 110 candetermine that the electronic device 100 is in a pocket. The processor110 can then instruct the echolocation module 122 to stop or reduceultrasound distance determination process in order to save batteryresources.

In some further alternative embodiments the processor 110 can determinefrom a plurality of output signals of the ultrasound determined distancereceived from the echolocation module 122 that the distance to theobject 308, 310 is changing. This means that the processor 110 candetermine that the object 308, 310 is moving. In some embodiments theprocessor 110 can detect movement and optionally generate an alarm ifmovement is detected. In this way the processor can detect intruders ina room where the user is sleeping and generate an alarm to wake theuser.

It shall be appreciated that the term electronic device and userequipment is intended to cover any suitable type of wireless userequipment, such as mobile telephones, portable data processing devicesor portable web browsers.

In general, the various embodiments may be implemented in hardware orspecial purpose circuits, software, logic or any combination thereof.For example, some aspects may be implemented in hardware, while otheraspects may be implemented in firmware or software which may be executedby a controller, microprocessor or other computing device, although theembodiments are not limited thereto. While various aspects of theapplication may be illustrated and described as block diagrams, flowcharts, or using some other pictorial representation, it is wellunderstood that these blocks, apparatus, systems, techniques or methodsdescribed herein may be implemented in, as non-limiting examples,hardware, software, firmware, special purpose circuits or logic, generalpurpose hardware or controller or other computing devices, or somecombination thereof.

The embodiments may be implemented by computer software executable by adata processor of the mobile device, such as in the processor entity, orby hardware, or by a combination of software and hardware. Further inthis regard it should be noted that any blocks of the logic flow as inthe Figures may represent program steps, or interconnected logiccircuits, blocks and functions, or a combination of program steps andlogic circuits, blocks and functions. The software may be stored on suchphysical media as memory chips, or memory blocks implemented within theprocessor, magnetic media such as hard disk or floppy disks, and opticalmedia such as for example DVD and the data variants thereof, CD.

The memory may be of any type suitable to the local technicalenvironment and may be implemented using any suitable data storagetechnology, such as semiconductor-based memory devices, magnetic memorydevices and systems, optical memory devices and systems, fixed memoryand removable memory. The data processors may be of any type suitable tothe local technical environment, and may include one or more of generalpurpose computers, special purpose computers, microprocessors, digitalsignal processors (DSPs), application specific integrated circuits(ASIC), gate level circuits (such as field programmable gate array—FPGAcircuits) and processors based on multi-core processor architecture, asnon-limiting examples.

Embodiments may be practiced in various components such as integratedcircuit modules. The design of PWB and RF designs are by and large ahighly automated process. Complex and powerful software tools areavailable for converting a design into a Printed Wired Board designready to be etched and formed on a substrate.

Programs automatically route conductors and locate components on asubstrate using well established rules of design as well as libraries ofpre-stored design modules. Once the design for a substrate or circuithas been completed, the resultant design, in a standardized electronicformat may be transmitted to a fabrication facility or for fabrication.

As used in this application, the term ‘circuitry’ refers to all of thefollowing:

(a) hardware-only circuit implementations (such as implementations inonly analog and/or digital circuitry) and

(b) to combinations of circuits and software (and/or firmware), such as:(i) to a combination of processor(s) or (ii) to portions ofprocessor(s)/software (including digital signal processor(s)), software,and memory(ies) that work together to cause an apparatus, such as amobile phone or server, to perform various functions and

(c) to circuits, such as a microprocessor(s) or a portion of amicroprocessor(s), that require software or firmware for operation, evenif the software or firmware is not physically present.

This definition of ‘circuitry’ applies to all uses of this term in thisapplication, including any claims. As a further example, as used in thisapplication, the term ‘circuitry’ would also cover an implementation ofmerely a processor (or multiple processors) or portion of a processorand its (or their) accompanying software and/or firmware. The term‘circuitry’ would also cover, for example and if applicable to theparticular claim element, a baseband integrated circuit or applicationsprocessor integrated circuit for a mobile phone or similar integratedcircuit in server, a cellular network device, or other network device.

The foregoing description has provided by way of exemplary andnon-limiting examples a full and informative description of theexemplary embodiment of this application. However, various modificationsand adaptations may become apparent to those skilled in the relevantarts in view of the foregoing description, when read in conjunction withthe accompanying drawings and the appended claims. However, all such andsimilar modifications of the teachings of this application will stillfall within the scope of this application as defined in the appendedclaims.

Indeed in there is a further embodiment comprising a combination of oneor more of any of the other embodiments previously discussed.

1. An apparatus comprising: at least one processor and at least onememory including computer code, the at least one memory and the computercode configured to with the at least one processor cause the apparatusto at least: cause generation of at least one predetermined ultrasoundsignal having a predetermined signal characteristic; receive at leastone reflected ultrasound signal based on the at least one predeterminedultrasound signal; determine whether the at least one reflectedultrasound signal comprises the predetermined signal characteristic;based on whether the at least one reflected ultrasound signal comprisesthe predetermined signal characteristic, determine a surroundinginformation around the apparatus based on the at least one reflectedultrasound signal; and modify behaviour or functionality of theapparatus based on the surrounding information.
 2. The apparatus ofclaim 1, wherein the apparatus is caused to cause generation of the atleast one predetermined ultrasound signal by directing the at least onepredetermined ultrasound signal in a direction towards at least oneobject.
 3. The apparatus of claim 1, wherein the predetermined signalcharacteristic comprises a predetermined frequency.
 4. The apparatus ofclaim 1, wherein the at least one predetermined ultrasound signalpropagates from the apparatus and is reflected by at least one object.5. The apparatus of claim 4, wherein the at least one memory and thecomputer code are further configured to with the at least one processorcause the apparatus to at least: determine a distance to the at leastone object based on a time lapse between transmission of the at leastone predetermined ultrasound signal with the predetermined signalcharacteristic and reception of the at least one reflected ultrasoundsignal having the predetermined signal characteristic.
 6. The apparatusof claim 5, wherein the at least one memory and the computer code arefurther configured to with the at least one processor cause theapparatus to at least: compare the distance with distance informationstored in the at least one memory of the apparatus; determine that thedistance matches with the distance information; and retrieve thesurrounding information associated with the distance information.
 7. Theapparatus of claim 1, wherein the at least one memory and the computercode are further configured to with the at least one processor cause theapparatus to at least: receive additional sensor information, whereinthe additional sensor information comprises location information of theapparatus; and determine the surrounding information based on theadditional sensor information.
 8. The apparatus of claim 7, wherein theat least one memory and the computer code are further configured to withthe at least one processor cause the apparatus to at least: receiveinput instructions associated with modifying the behaviour orfunctionality of the apparatus based on the location information; andmodify the behaviour or functionality of the apparatus according to theinput instructions in an instance in which the distance informationmatches the additional sensor information.
 9. The apparatus of claim 1,further comprising: one or more ultrasonic transmitters configured togenerate the at least one predetermined ultrasound signal; and one ormore ultrasonic receivers configured to receive the at least onereflected ultrasound signal.
 10. The apparatus of claim 9, wherein theone or more ultrasonic transmitters are further configured to transmit aplurality of ultrasound signal at different frequencies; and the one ormore ultrasonic receivers are further configured to detect reflectedultrasonic signals at the different frequencies.
 11. The apparatus ofclaim 9, wherein the one or more ultrasonic transmitters are furtherconfigured to generate a plurality of ultrasound signals directed indifferent directions.
 12. The apparatus of claim 11, wherein the one ormore ultrasonic receivers are further configured to receive reflectedultrasound signals from the different directions.
 13. The apparatus ofclaim 12, wherein the at least one memory and the computer code arefurther configured to with the at least one processor cause theapparatus to at least: determine a plurality of objects based on thereflected ultrasound signals from the different directions.
 14. Theapparatus of claim 13, wherein the at least one memory and the computercode are further configured to with the at least one processor cause theapparatus to at least: determine a location of the apparatus relative tothe plurality of objects based on the reflected ultrasound signals fromthe different directions.
 15. The apparatus of claim 1, wherein theapparatus is one of an electronic device, a mobile device, or a headset.16. The apparatus of claim 1, further comprising: one or moretransducers configured to generate the at least one predeterminedultrasound signal and to receive the at least one reflected ultrasoundsignal.
 17. The apparatus of claim 1, further comprising: one ultrasonictransmitter configured to generate the at least one predeterminedultrasound signal; and a plurality of ultrasonic receivers configured toreceive the at least one reflected ultrasound signal.
 18. The apparatusof claim 1, further comprising: one transducer configured to generatethe at least one predetermined ultrasound signal and to receive the atleast one reflected ultrasound signal.
 19. A method comprising: causinggeneration of at least one predetermined ultrasound signal having apredetermined signal characteristic; receiving at least one reflectedultrasound signal based on the at least one predetermined ultrasoundsignal; determining whether the at least one reflected ultrasound signalcomprises the predetermined signal characteristic; based on whether theat least one reflected ultrasound signal comprises the predeterminedsignal characteristic, determining a surrounding information around theapparatus based on the at least one reflected ultrasound signal; andmodifying behaviour or functionality of the apparatus based on thesurrounding information.
 20. A computer program product comprising: atleast one computer readable non-transitory memory medium having programcode instructions stored thereon, the program code instructions whichwhen executed by an apparatus causes the apparatus at least to: causegeneration of at least one predetermined ultrasound signal having apredetermined signal characteristic; receive at least one reflectedultrasound signal based on the at least one predetermined ultrasoundsignal; determine whether the at least one reflected ultrasound signalcomprises the predetermined signal characteristic; based on whether theat least one reflected ultrasound signal comprises the predeterminedsignal characteristic, determine a surrounding information around theapparatus based on the at least one reflected ultrasound signal; andmodify behaviour or functionality of the apparatus based on thesurrounding information.